A Real Space Renormalization Group Approach to Field Evolution Equations. 
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I. INTRODUCTION 

The use of Real Space Renormalization Group (RSRG) 
techniques ^| to analyze questions related to the dis- 
cretization of classical evolution field equations has re- 
cently raised a great deal of attention. Promising results 
have been achieved from the concept of perfect action || 
and its application to deterministic partial differential 
equations (PDE) H Recently, the group of Golden- 
feld et al. extended the idea to stochastic PDE (6j by 
using a space-time Monte-Carlo formalism for classical 
problems 0. In this last work, interesting non-local ef- 
fects were discovered. 

The present work tries to develop further the line 
traced in || generalizing the notion of coarse-graining. 
The fields are assumed to be defined on spatial cells and 
a mechanism to define truncation operators is provided 
based on the overlapping of cells in different partitions 
of space. Both linear and non-linear 1+1-PDE are an- 
alyzed. Stochastic equations are not dealt with in the 
present work, but it should be noticed that the formalism 
of H may be easily adapted to include the new trunca- 
tion operators. 

This paper is organized as follows: The next section 
discusses the RSRG operator formalism which shall be 
applied. Our geometric construction of the truncation 
operators is explained in detail in the third section. Sec- 
tion four is devoted to the exposition of some numerical 
results. Some concluding remarks and proposals for later 
work are discussed in the last section. 



II. THE FORMALISM 

Let V be a partition of a given region of a manifold 
A4, composed of the cells {Ci}^L 1 . Let <j> be a scalar field 
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on that region of space and consider the discretization 
associated to the partition 



d\i <fr(x) 



(1) 



M 



where /i is any measure on M.. Let us, furthermore, 
consider the following evolution equation, which we will 
assume exact |j| : 



= H, 



(2) 



This scheme can hold easily any linear evolution equa- 
tion, with a great variety of boundary conditions. Equa- 
tion (0) may result from the discretization of any linear 
PDE (or even a non-local equation) within any explicit 
or implicit algorithm. The operator H shall be termed 
the evolution generator. 

Some non-linear equations may enter easily this formal- 
ism. For example, any quadratic evolution generator 
might be added as 



(3) 



This allows study of surface growth phenomena as gov- 
erned by the Kardar-Parisi-Zhang (KPZ) equation 
or the related ID turbulence described by Burgers equa- 
tion. More complex equations such as Navier-Stokes are 
by the moment out of reach of the formalism because the 
fields under study are not scalar. 

The field discretizations as defined by equation ([!]) find 
their natural place in a vector space E N . A truncation 
operator R : E N i— > E defines a sub-discretization 
within the original vector space. The effective field 
component indices shall be denoted with capital letters: 
{4>'j} € E M . The new discretization only provides M 
degrees of freedom and, thus, the R operator must have 
a non-trivial kernel. 

The truncation operator shall be chosen to be linear [jll| . 
This enables us to write its action as 
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Rli 



(4) 
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Had the R operator got a trivial kernel, an inverse oper- 
ator might be written, which would be called the 
embedding operator. In this case the following equation 
would be exact 



d t 4>i = HijRjjipj , 



(5) 



One might therefore evolve the effective discretization 
with only M degrees of freedom through equation 



(6) 



where H' is the renormalized evolution generator. After 
the evolution of the reduced discretization has been com- 
pleted, the evolution of the original discretization would 
be found 



(7) 



Equation (o) requires less storage and CPU time than 
equation (0) to be simulated on a computer. We may 
express this situation by the commutative diagram 



E N 
I 



H 



E N 
\ 



(8) 



E 



H 



E 



M 



Unfortunately, the situation displayed in the previous 
paragraph is impossible: the truncation operator must 
have a non-trivial kernel. Thus, it lacks a true inverse. 
Anyway, a "best possible" pseudo-inverse may be found: 
an operator R p which fulfills the Moore-Penrose condi- 
tions 111 



RR P R 
(R P R)^ 



R 

R P R 



R P RR P 
(RR p )^ 



RP 
RR P 



(9) 



Those equations are solved only if R p is the singular val- 
ues decomposition (SVD) pseudo-inverse of R. RP is an 
"extrapolation" operator, which takes an E M (reduced) 
discretization and returns an approximate E (full) one. 
The only important piece of information contained in R is 
its kernel, which represents the degrees of freedom which 
are removed (see, e.g. 13 ). RRP is the identity operator 
on E M and RPR is a projector on the relevant degrees of 
freedom subspace of E N . These degrees of freedom are 
stored as the column of the matrix R. It is highly recom- 
mended to orthonormalize these column vectors, because 
R p becomes simply R^ . 

Using the pseudo-inverse R p instead of R^ 1 the diagram 
(^J) does not commute. The "curvature" represents the 
error of the procedure. The renormalized evolution gen- 
erator is written as: 



H'xj 



RuHijRPj 



(10) 



where indices are kept for clarity. A quadratic evolution 
generator would be transformed in this way: 



Q'i 



JK 



RnQijkR^jR] 



ki< 



(11) 



This expression shall be shorthanded as Q' = RQR P . 
Higher degree operators are possible, of course. 

The election of the R operator is the key problem. Ide- 
ally it should depend on the problem at hand, i.e. on the 
field equation and the observables we want to measure. 
In this paper a geometrical approach is introduced which 
is independent of the physics of the dynamical system, 
but uses a quasi-static truncation procedure for a careful 
selection of the relevant degrees of freedom. 
The schedule for all the simulations that shall be pre- 
sented in the rest of this work is: 

1.- Present a Hamiltonian H (at most quadratic) and an 
initial field (f>(0). 

2 - Perform the exact evolution and obtain (f>(t). 

3. - Propose a truncation operator R and obtain the 
pseudo-inverse R p . 

4. - Calculate the renormalized Hamiltonian and the trun- 
cated initial field: H' = RHR P and 0'(O) = R<j>(G). 

5. - Perform the renormalized evolution on </>'(0) and ob- 
tain 4>'{t). 

6. - Compare <j){t) and R p cj>'(t). 

We distinguish between a real space error, which is 
given by the L 2 norm of [<f>(t) — R p 4>'(t)] (a vector from 
E ) and the renormalized space error, which is given by 
the I? norm of [R(f)(t) - (j)'(t)} (a vector from E M ). Both 
errors need not be equal. It is impossible for the first 
error to vanish for all (f)(0) and all time, although that 
is possible for the second one. In that case, the retained 
degrees of freedom are exactly evolved after the rest of 
the information has been removed. Such a situation cor- 
responds to a perfect action. 



III. GEOMETRIC TRUNCATION OPERATORS 

In this section a set of construction rules for the R op- 
erator shall be presented which shall allow for practical 
computations. 

Let us consider the ID interval [0, 1] and let V n denote 
a regular partition of that interval into n equal cells, de- 
noted by Cf = [^i, i]. The truncation operator R M ^ N 
shall be defined by 



R 



Mi-N 
Ii 



M (Cf n cf) 



(12) 



M(Cf) 

where /i(-) denotes the standard measure in R, d is a 
cell of the source partition Vn and Ci is part of the 
destination one Vm- In geometrical terms, the R matrix 
elements are given by the ratio 

_ N Overlap between cells Ci and C/. 



H Ii 



Measure of cell Cr 



(13) 



3 



The rationale behind this expression may be expressed 
with a physical analogy. Let us consider <^ as the density 
of a gas in the i-th cell of the source partition, limited by 
impenetrable walls. Now a new set of walls is settled: the 
ones corresponding to the new (destination) partition. 
The old walls are, after that, removed. The gas molecules 
redistribute uniformly in each new cell. The new densi- 
ties are the values which constitute the transformed 
field discretization. Figure [l] should be helpful. 
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FIG. 1: A part of two overlapping partitions is depicted. The 
lines delimiting the "old" partition are thin (cells A, B...), 
while the thick lines belong to the "new" one (1, 2,...). For 
example, there shall be no R matrix element between cells 1 
and C, since they do not overlap. On the other hand, the 
matrix element Ria must be close to 1. 



adiabatic truncation operators. These are defined by: 



(15) 



Of course, qR M ^ N differs greatly from R M ^ N . The 
term "quasistatic" is suggested by the thermodynamical 
analogy introduced before. The relation between qua- 
sistaticity and reversibility leads us to think that the 
qR M ^ N may be better suited to our purposes. 

A single step sudden transformation is given analyti- 
cally by 



R 



N-l<-N 



= Sr 



N -I 



(16) 



Iterating this relation it can be proved that the qua- 
sistatic operators fulfill the recursion relation: 



M + 1 



M + l 



-iRn 



M+l<-N 



I 



M+li-N 



M+l 



1 R I+1 



(17) 



This relation allows to calculate the matrices using no 
matrix products. This expression improves greatly the 
efficiency of the numerical applications. 

The degrees of freedom which are retained by the qua- 
sistatic truncation matrix are plotted in figure 0. They 
are the E N vectors given by the columns of qR . 



In more mathematical terms, the value of 4>i is a linear 
estimate for 

<f>i = [ 4>{x)dx (14) 

JCi 

conserving the total mass: y\ (f>i = Y), 4>j. Equation 
( |l2| ) may also remind of the definition for conditional 
probability. 

The resulting R M *~ N operators shall be termed sudden 
truncation operators. Compared to standard RSRG inte- 
ger factor blocking techniques |5|, the operators R M ^ N 
allow for a greater flexibility. For example, it is possible 
to remove a single degree of freedom (see figure ^]for a ID 
example). The sudden truncation operators do not form 




FIG. 3: Some of the degrees of freedom which are retained by 
the quasi-static truncation operator proceeding from 80 — > 20 
sites. Cells 1, 5, 10, 15 and 20 are depicted. Notice that 
the "cells" are now overlapping and have slightly Gaussian 
nature. 
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FIG. 2: The lower partition has just a single degree of freedom 
less than the one above. A truncation matrix may be written 
to proceed from one to the other. 

a closed algebra. The composition of sudden truncation 
operators shall take us to the concept of quasistatic or 



Each of the discrete functions depicted in figure |3| may 
be considered to represent a relevant degree of freedom 
when truncating with the matrix qR 20 ^ 80 . Although the 
functions representing the degrees of freedom are now 
overlapping, they conserve a true real-space nature. It 
should be noticed that the width of the leftmost and 
rightmost cells is smaller than the one at the middle of 
the interval. A consequence is the quite exact represen- 
tation of the boundary conditions. 

It should be remarked that other authors have already 
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introduced overlapping blocks within RSRG applica- 
tions Inter-cell correlations, which are the key to 
the most successful RSRG algorithms are usu- 
ally captured more easily within an overlapping cells ap- 
proach. 

The most usual sub-discretization approach is the deci- 
mation method, where one degree of freedom out of every 
/ is considered relevant. This truncation scheme may not 
be represented within our formalism. The reason is that 
the implementation on the field discretization is given by 
the matrix 

D n = S f i,i . (18) 

But the R matrix (|lj) along with its SVD pseudo-inverse 
yields a trivial dynamics, because the retained degrees of 
freedom are not in contact. A possible solution to con- 
serve linearity, though losing the Moore-Penrose condi- 
tions (H). 

A discrete Fourier Transform along with a cutoff might 
be a suitable linear truncation procedure, but we shall 
not leave the RSRG setting: our relevant degrees of free- 
dom do have a local geometric meaning. 
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IV. APPLICATIONS AND NUMERICAL 
RESULTS 

This section discusses some numerical applications, 
both to linear and non-linear examples. 



A. Heat Equation 



FIG. 4: An random increments function is taken as the ini- 
tial condition (up) with 200 cells. Below, the continuous 
line shows the exact evolution under the heat equation with 
K = 1/2, along 500 time-steps with At = 5 • 10" 6 . The tri- 
angles are given by the quasistatic approximation with 20 
degrees of freedom. The circles represent the sudden approxi- 
mation, and the squares follow the sudden approximation, i.e. 
conventional symmetric coarse-graining. 



The heat equation on any space is defined by stating 
that the evolution operator is given by the minus the 
Laplacian on such a space. It is known that the Lapla- 
cian operator may be sensibly defined on a great variety 
of spaces |Q, including discrete spaces Jl8| . 
Our ID interval shall always be [0, 1]. As it is split into 
N cells, the cells width is always Ax — 1/N. The struc- 
ture is given by the discrete Laplacian matrix on a linear 
graph: 

Lij = 2S hj - , (19) 

with fixed boundary conditions L\\ = Ljvjv = 2. The 
equation shall be given by 

d t <f>i = --^Lijcpj . (20) 

The first test shall be a random increments initial condi- 
tion, i.e. it fulfills the equation: 

cf) l+1 = fa + r (21) 

with r a random variable with mean zero, equally dis- 
tributed in an interval of width A. Using N = 200, 
M = 20 and A = 1/4 (a quite severe reduction of a fac- 
tor 10) we obtain the results depicted in figure g The 



TABLE I: Comparative of errors between different truncation 
schemes for heat equation on the random-increments initial 
condition depicted in figure H. 



Method 


Real Space Error 


Renormalized Space Error 


Quasistatic 


0.53% 


0.29% 


Sudden 


20% 


19% 


Decimation 


13% 


4.7% 



errors for the results of figure |l| are summarized in table 
|j| Errors are noticed to be smaller in renormalized space. 
The reason is that in real space two sources of error get 
mixed: the possibility of representation of the initial data 
with the restricted degrees of freedom and the dynamical 
relevance of the removed information. In renormalized 
space only the second type of error contributes. 
To examine the relevant scaling laws |rJ , a discretization 
of <f>(x) — §(x — 1/2) is defined on the 200 cells partition, 
and is normalized according to 

N 

&x<t>i = 1 • (22) 

i = 1 
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Under time evolution, the peak becomes a Gaussian func- 
tion and its width W follows the law 

N 

W(t) = i&xfa ~ i 1/2 . (23) 
i = 1 

Equation ( p3| ) can be proved to be exact also in the dis- 
crete case as shown in the appendix. 
Using the same constants as in the previous calculation, 
we have performed a quasistatic simulation of the same 
problem, and depicted in figure || a log-log plot of the 
width against time: The data from the quasistatic simu- 
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FIG. 5: Log- log plot of the width of the Gaussian against 
time. The steady straight line has slope ~ 0.5. 

lation in figure ^| fit, after a transient, to a straight line 
with slope 0.4990 ± 0.0001. The exact field evolution 
yields exactly the same value, without the transient. The 
sudden approximation saturates at long times. Usual 
decimation gives a correct result. 



B. Low Energy States in Quantum Mechanics 

Researchers in RSRG methods have spent many efforts 
in developing techniques for the approximate obtention 
of the low-energy spectrum of quantum mechanical prob- 
lems Q . The reason was not the difficulty of the prob- 
lem but of technical nature. With the development of the 
Density Matrix RG, Correlated Blocks RG, etc. Jl|, 
in the 90's, the problem was considered to be solved. 
The quasistatic approach allows a very accurate approxi- 
mation to the lowest energies of many quantum mechan- 
ical ID systems. The transformation H — > H' = RHB) 
may yield an effective transformation of a Hamiltonian 
matrix, provided that the transformation R is orthog- 
onal. In this case, the diagonalization of H' yields a 
variational Ansatz approach to the real spectrum. The 



Ansatz is of the form 

M 

|*) = (24) 

where \cf>i} are the rows of qR M ^ N after a orthonormal- 
ization procedure, and the ai are the variational param- 
eters. The diagonalization of the quasistatically trun- 
cated Laplacian yields very precise values. For example, 
if N = 100 and M — 10, we obtain the values for the 
spectrum of — L exposed in table ||. 

TABLE II: Low energy spectrum of a particle in a box split 
into 100 discrete cells, calculated through exact diagonaliza- 
tion, and two effective variational RG techniques: sudden and 
quasistatic transformations. 



Method 












Exact 

Quasist. 

Sudden 


0.000967435 
0.000967435 
0.008101410 


0.0038688 
0.0038688 
0.0317493 


0.008701 
0.008701 
0.069027 


0.015460 
0.015463 
0.116917 


0.02413 
0.02471 
0.17153 



The bad results for the sudden approximation are a 
bit misleading |2C|j . For example, the real space error 
measured according to the L 2 norm for the ground state 
is only around 11%. The source of error is the lost of 
smoothness. The rest of the eigenvalues (up to 10) do 
not fit as well as the first ones. 

The method has also been tested with the harmonic os- 
cillator and other potentials with equally good results, 
as long as the wave-functions are smooth. In case of a 
potential given by Vi = V(xi), the Hamiltonian operator 
is just -Lij + ViSij. 

C. Kardar-Parisi-Zhang Equation 

The Kardar-Parisi-Zhang (KPZ) equation is widely 
used as a model of stochastic and deterministic surface 
growth [ [To| . Here we use the deterministic form defined 
as 

d t <f> = A|V</>| 2 + kV 2 </> (25) 

representing a surface in which absorption/desorption 
phenomena take place. The squared gradient term shall 
be implemented through the quadratic operator 

Kijk = — 5j t i-x) (5k,i+i — Sk,i-i) (26) 

which is obtained through the centered derivatives ap- 
proximation to the gradient Boundary conditions 
are imposed for which forward and backward derivatives 
are employed. 

The first test evolves an initial condition given by a si- 
nusoidal function 4>{x) = sin(47rx) with x s [0,1]. The 
resolution change is 40 — > 20 and 2000 time steps with 
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FIG. 6: A sinusoidal surface profile evolved by the KPZ dy- 
namics with the parameters explicitly given in the text. No- 
tice that a slight asymmetry in the initial function (a lattice 
artifact) develops a high asymmetry in the exact and qua- 
sistatic approximations. 



FIG. 7: Random increments function (above) built in the 
same way as that of figure 0. Below, the exact evolution is dis- 
played by the continuous line. Squares mark the quasistatic 
truncation approximation, while the dashed lines follow the 
sudden and the decimation truncations. 



At = 5 • 1CP 6 were simulated. Figure |^ shows the results 
for A = 2 and k = 1/2. The errors for such a test are 
given in table 111. A different test was carried out with 



TABLE III: Errors in the evolution of a sinusoidal initial con- 
dition under KPZ equation, corresponding to the results of 
figure []. The parameters are explicitly given in the text. 



Method 


Real Space Error 


Renormalized Space Error 


Quasist. 


0.5% 


0.2% 


Sudden 


39% 


38% 


Decim. 


15% 


8% 



a random increments function, as for the heat equation. 
The rest of the parameters are the same as in the previous 
simulation. The results of this simulation are displayed 
in figure ^ and the numerical errors are provided in table 

rvl 



Some more nonlinear equations have been tried, such 
as Burgers and others, with comparable results. We 
encourage the reader to experiment. 



TABLE IV: Errors corresponding to the field evolution of a 
random- increments initial condition, shown in figure |^. 



Method 


Real Space Error 


Renormalized Space Error 


Quasist. 


0.23% 


0.23% 


Sudden 


12% 


11% 


Decim. 


9.4% 


6.5% 



D. Efficiency issues. 

A problem which must be remarked is that the approxi- 
mation renders new evolution generators which may have 
a greater number of non-null entries than the originals. 
The elements typically decrease in magnitude as a power 
of their distance to the diagonal, albeit they often alter- 
nate signs. This corresponds to the non-local space-time 
effects remarked by Goldenfeld et al. 0. 
This fact forces the practitioner to make computational 
complexity estimates before trying this method. Various 
factors should be pondered: 

• Reduction factor attainable for a given equation. 
KPZ stands more than 50% reduction for a wide set of 
initial conditions. The heat equations stands more than 
90%. 

• Availability and stability of local explicit methods. If 
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implicit methods must be used, or the equation has non- discussions, 
local nature, then the original equation is already long 
ranged and no loss of efficiency comes from applying the 
RSRG recipe described. 



V. CONCLUSIONS AND FUTURE 
PROSPECTIVES 

A new formalism has been provided to deal with the 
reduction of degrees of freedom for a wide set of field 
evolution equations. The basis of the formalism is the 
integral specification of the field values (i.e.: it is related 
to finite volume methods). The key concept to find the 
transformation between a partition of space and another 
is the overlapping of cells. 

Our specific recipe stands removal of 90% of the de- 
grees of freedom without distortion for linear PDE such 
as the heat equation, and 50% reduction without appre- 
ciable loss of accuracy for KPZ and related nonlinearities. 

The main handicap of the technique is shared by all 
known strategies to the reduction of degrees of freedom: 
the appearance of nonlocal effects which may spoil the 
efficiency [pi. Future works on this algorithm should 
try to find suitable short-ranged approximations to the 
renormalized evolution generators. Also the extension 
to stochastic PDE makes nonlocal effects appear: a spa- 
tially white noise shall develop a nontrivial covariancc 
matrix. The eigenfunctions of this matrix would be the 
appropriate basis. 

It is easy to generalize the formalism to higher dimen- 
sions, but the algorithms to find cell overlappings is trick- 
ier. Nevertheless, fields of vectorial nature do not fit well 
in this formalism. The authors are developing a "differ- 
ence forms" theoretical frame to deal with them, in the 
line traced by Katz and Wiese [Q. 

But the main interest of the authors at the present 
moment is a different extension: to find an algorithm in 
which the degrees of freedom are not of geometric nature, 
but are chosen by the equation itself. 
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APPENDIX A: SCALING OF THE DISCRETE 
HEAT EQUATION. 

In this appendix the exactness of relation ( p3| ) subject 
to any coarse-graining procedure keeping the normaliza- 
tion condition ( |l4| ) is proved. 

We generalize the definition in ( p3| ) to the expectation 
value for any observable O on a one dimensional lattice 
composed of N sites according to 

N 

(0) t = Ot,iAx<t>t,i (Al) 
i=i 

with the total time t = n At and n the number of dis- 
crete time evolutions. 

Relation ( p3| ) also describes Brownian motion on a ID 
lattice. According to Wick's theorem [^3| , it is sufficient 
to prove the linear dependence of the second moment 
(x 2 ) on time for any discretization scale, as the following 
proposition states: 

Proposition. The second moment (x 2 ) as defined by 
definition (^3|) for the diffusion field <j) is given by (sup- 
posing free or periodic boundary conditions): 

(x 2 ) t = 2Kt + <7(& =0 ) , (A2) 

subject to the normalization constraint p^). Here, 
C(4>t=o) is a constant which depends on the initial field 
configuration and , for a 6 initial condition, C{<pt=o) = 0. 
In equation ( |A2| ), t is the time, k is the diffusion con- 
stant and no dependence on the discretization scale Aa; 
is involved. 

Using definition ( |Al| ) to define the second moment (a; 2 ) 
we have 



N 



N 



(x 2 ) t+ i = Az (i Ax) 2 (/> t+M = ^i 2 (Ax) 



' At- , 

XAx) 



2 • ■ 



»t,i+l 



) + 



(A3) 



The evolution equation uses a discrete Laplacian (|19|) index shifting, along with the supposition of either free 
and a forward time Euler scheme |2l| . Some algebra and or periodic boundary conditions lead to 
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t+i 



N 

2k At J2{ &x<t>t,i\ + (x 2 )t 



(A4) 



The equation is rewritten, taking into account that 
( [22| ) is valid for all time, as 

{x 2 ) t+1 = 2k At + {x 2 ) t . (A5) 

Iterating the procedure n times yields the final result 

(x 2 ) t+1 = 2k (i + 1) + (xVo • (A6) 



Defining C{<j)t = a) = (x }t=o and changing the index i+ 1 
to t we get the result stated in the above proposition. If 
the initial field configuration 4>t=o is provided by t he 5 
peak which was used to generate figure [5] equation ( AG ) 
simplifies to 



2nt 



(A7) 



Equation (A7) is equivalent to the calculation of the 
mean squared distance of a random walker after the time 
t starting at the center position, i.e. the location of the 
S peak. 
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